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^ , Abstract 

The dynamics of an agreement protocol interacting with a disagreement process over a 
common random network is considered. The model can represent the spreading of true and 
false information over a communication network, the propagation of faults in a large-scale 
control system, or the development of trust and mistrust in a society At each time instance 
and with a given probability, a pair of network nodes are selected to interact. At random each 
of the nodes then updates its state towards the state of the other node (attraction), away from 
the other node (repulsion), or sticks to its current state (neglect). Agreement convergence and 
disagreement divergence results are obtained for various strengths of the updates for both 
symmetric and asymmetric update rules. Impossibility theorems show that a specific level of 
attraction is required for almost sure asymptotic agreement and a specific level of repulsion 
is required for almost sure asymptotic disagreement. A series of sufficient and/or necessary 
conditions are then established for agreement convergence or disagreement divergence. In 
particular, under symmetric updates, a critical convergence measure in the attraction and 
repulsion update strength is found, in the sense that the asymptotic property of the network 
state evolution transits from agreement convergence to disagreement divergence when this 
measure goes from negative to positive. The result can be interpreted as a tight bound on 
how much bad action needs to be injected in a dynamic network in order to consistently 
steer its overall behavior away from consensus. 

Keywords: Dynamic networks, Opinion dynamics, Gossiping, Social networks, Consensus 
algorithms, Network science 



1 Introduction 

1.1 Motivation 

A growing number of applications are composed of a networked information structure executed 
over an underlying communication network. Examples include social networks run over the In- 
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ternet, control networks for the power grid, and information networks serving transportation 
systems. These networks are seldom centrally regulated, but have a strong component of dis- 
tributed information processing and decision-making. While these systems are able to provide 
appropriate service to their users most of the time, open software and communication technolo- 
gies, together with the large geographical scale of the systems, make them more exposed to 
faulty components, software bugs, communication failures and even purposeful injection of false 
data. 

An interesting problem is to try to understand the amount of deficiencies that can be tol- 
erated in the combined network before the global system performance is compromised. In this 
paper we tackle this challenging problem for a model inspired by agreement protocols, whose ex- 
ecution have been studied intensively over the last decade in a variety of settings, including load 
balancing in parallel computing [HI [14] , coordination of autonomous agents [HI [16] , distributed 
estimation and signal processing [TTl [18] , and opinion dynamics in social networks jT9l [20l El] . 
In this model, a pair of nodes is selected randomly at each time. The nodes update their scalar 
states by forming a weighted average of their own state with the state of the other node. Such 
a dynamic network protocol is sometimes called gossiping and its convergence is fairly well un- 
derstood. To account for system defects and node misbehavior, we extend the basic gossiping 
model in the following way. Rather than always executing the regular update, which we call an 
attraction step, nodes do so with a certain probability every time they are drawn. If a node does 
not perform the attraction step, it randomly either updates its own state away from the other 
nodes state (we call this a repulsion step) or simply chooses not to perform a state update but 
to stick to its current value (which we call neglect). We believe that our model is one of the 
first to consider faulty and misbehaving nodes in gossiping algorithms. Based on our model, it 
is possible to analyze almost sure (a.s.) convergence to agreement and derive explicit criteria 
for the amount of node deficiencies that can be tolerated while still guaranteeing that all node 
states converge to a common value. By interpreting the repulsion step as a simple model for 
node misbehavior or faults, these criteria also characterize the strength or persistency of node 
misbehavior that is required to force the nodes to an overall disagreement. 

1.2 Related Work 

The structure of complex networks, and the dynamics of the internal states of the nodes in these 
networks, are two fundamental issues in the study of network science [8]. 

Probabilistic models for networks such as random graphs, provide an important and conve- 
nient means for modeling large-scale systems, and have found numerous applications in various 
fields of science. The classical Erdos-Renyi model, in which each edge exists randomly and in- 
dependently of others with a given probability, was studied in [3] . The degree distribution of the 
Erdos-Renyi graph is asymptotically Poisson. Generalized models were proposed in [3] and [5], 
for which the degree distribution satisfies certain power law that better matches the properties 
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of real-life networks such as the Internet. A detailed introduction to the structure of random 
networks can be found in [6l [TJ. 

When a networked information is executed on top of an underlying network, nodes are en- 
dowed with internal states that evolve as nodes interact. The dynamics of the node states depend 
on the particular problem under investigation. For instance, the boids model was introduced in 
[9] to model swarm behavior and animal groups, followed by Vicsek's model in [10]. Models of 
opinion dynamics in social networks were considered in [191 [20| [46] and the dynamics of com- 
munication protocols in [47]. Distributed averaging or consensus algorithms have relative simple 
dynamics for the network state evolution and serve as a basic model for the complex interaction 
between node state dynamics and the dynamics of the underlying communication graph. 

Convergence to agreement for averaging algorithms have been extensively studied in the lit- 
erature. Early results were developed in a general setting for studying the ergodicity of nonhomo- 
geneous Markov chains |22[ 123] . Deterministic models have been investigated in finding proper 
connectivity conditions that ensure consensus convergence [MJ [251 ESI [271 ES EH [301 ED E2] • 
Averaging algorithms over random graphs have also been considered [331 EH E51 EH E7J ESI EH] . 

In this paper, we use the asynchronous time model introduced in |42] to describe the ran- 
domized node interactions. Each node meets other nodes at independent time instances defined 
by a rate-one Poisson process, and then a pair of nodes is selected to meet at random deter- 
mined by the underlying communication graph. Gossiping, in which each node is restricted to 
exchange data and decisions with at most one neighboring node at each time instance, has 
proven to be a robust and efficient way to implement distributed computations and signal pro- 
cessing [TBI HOI HH H21 H31 HH H5l HH1 H7] . A central problem here is to analyze if a given gossip 
algorithm converges to consensus, and to determine the rate of convergence of the consensus 
process. Karp et al. [40] derived a general lower bound for synchronous gossip. Kempe et al. [H] 
proposed a randomized gossip algorithm on complete graphs and determined the order of its 
convergence rate. Boyd et al. [32] established both lower and upper bounds for the convergence 
time of synchronous and asynchronous randomized gossip algorithm, and developed algorithms 
for optimizing parameters to obtain fast consensus. Fagnani and Zampieri discussed asymmetric 
gossiping in |43j . Liu et al. [2] presented a comprehensive analysis for the asymptotic con- 
vergence rates of deterministic averaging, and recently distributed gossip averaging subject to 
quantization constraints was studied in [15] . A nice and detailed introduction to gossip algo- 
rithms can be found in [47] . 

The model we introduce and analyze in this paper can be viewed as an extension to the 
model discussed by Acemoglu et al. who used a gossip algorithm to describe the spread 
of misinformation in social networks. In their model, the state of each node is viewed as its 
belief and the randomized gossip algorithm characterizes the dynamics of the belief evolution. 
We believe that our model is one of the first to consider faulty and misbehaving nodes in gossip 
algorithms. While the distributed systems community has since long recognized the need to 



3 



provide fault tolerant systems, e.g., [55\ [56], efforts to provide similar results for randomized 
gossiping algorithms have so far been limited. This paper aims at providing such results. 

1.3 Main Contribution 

The main contribution of this paper is to provide conditions for agreement convergence and 
disagreement divergence over random networks. To study this problem, we use a model of asyn- 
chronous randomized gossiping. At each instance, two nodes are selected to meet with a given 
probability. When nodes meet, normally they should update as a weighted average (attraction). 
Besides that, we assume that nodes can misbehave in the sense that they can take a weighted 
combination with one negative coefficient (repulsion), or they can stick to their current state 
(neglect). The potential node misbehavior essentially results in model uncertainties in the consid- 
ered algorithm. Each node follows one of the three update rules at random by given probabilities 
whenever it is selected to meet another node. From an engineering viewpoint, this is a simple 
model of faults or data attacks for distributed computations. From a social network perspec- 
tive, the model constitutes a non-Bayesian framework for describing how trust and mistrust of 
information can propagate in a society. 

A fundamental question we answer is whether the network will converge to agreement (all 
nodes asymptotically reach the same value a.s.) or diverge to disagreement (all nodes disperse 
a.s.). We study both symmetric and asymmetric node updates 03] . Two general impossibility 
theorems are first proposed. Then, a series of sufficient and/or necessary conditions are es- 
tablished for the network to reach a.s. agreement convergence or disagreement divergence. In 
particular, under symmetric updates, a critical convergence measure is found in the sense that 
the asymptotic evolution of the network states transits from agreement to disagreement when 
this measure switches from negative to positive. This critical measure is in fact independent of 
the structure of the underlying communication graph. In other words, under the node dynamics 
considered in this paper, there is no difference if the underlying network is an Erdos-Renyi 
graph [3] , a small- world graph [I] , or a scale- free graph [5] , for the network to reliably target an 
agreement. 

1.4 Outline 

The rest of the paper is organized as follows. In Section 2, we introduce the network model, 
the considered algorithm, the problem formulation, together with some physical motivation 
for the model. Section 3 presents two general impossibility theorems on a.s. agreement and 
disagreement, respectively. In Section 4, we discuss the model in the absence of node repulsion 
and give conditions for a.s. agreement convergence for both symmetric and asymmetric update 
steps. Section 5 presents agreement and disagreement conditions for the general model. Finally, 
some concluding remarks are given in Section 6. 
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2 Problem Definition 



In this section, we present the considered network model and define the problem of interest. 

We first recall some basic definitions from graph theory [2] and stochastic matrices pQ. A 
directed graph (digraph) Q = (V, £ ) consists of a finite set V of nodes and an arc set £ C V x V. 
An element e = G £ is an arc from node i G V to j G V. A digraph is bidirectional 

if for every two nodes i and j, £ £ if and only if £ £; Q is weakly connected if it is 

connected as a bidirectional graph when all the arc directions are ignored. The converse graph, 
Q T of a digraph Q = (V,£), is defined as the graph obtained by reversing the orientation of all 
arcs in £. A finite square matrix M = [rriij] G R nxn is called stochastic if my > for all i,j 
and Ylj m ij = 1 f° r an A stochastic matrix M is doubly stochastic if also M T is stochastic. 
Let P = \pij] G IR nxn be a matrix with nonnegative entries. We can associate a unique digraph 
Q P = (V, £p) with P on node set V = {1, . . . , n} such that (j, i) G £p if and only if pij > 0. We 
call Qp the induced graph of P. 

2.1 Node Pair Selection 

Consider a network with node set V = {1, . . . ,n}, n > 3. Let the digraph C?o = (V,£o) denote 
the underlying graph of the considered network. The underlying graph indicates potential inter- 
actions between nodes. We use the asynchronous time model introduced in [42J to describe node 
interactions. Each node meets other nodes at independent time instances defined by a rate-one 
Poisson process. This is to say, the inter-meeting times at each node follows a rate-one expo- 
nential distribution. Without loss of generality, we can assume that at most one node is active 
at any given instance. Let xi{k) G K, denote the state (value) of node % at the /c'th meeting slot 
among all the nodes. 

Node interactions are characterized by an n x n matrix A = [a.y], where ay > for all 
i,j = 1, . . . ,n and a^ > if and only if (j,i) G £$. We assume A is a stochastic matrix. The 
meeting process is defined as follows. 

Definition 1 (Node Pair Selection) Independent of time and node state, at time k > 0, 

(i) A node i G V is drawn with probability 1/n; 

(ii) Node i picks the pair with probability aij. 

Note that, by the definition of the node pair selection process, the underlying graph Qq is 
actually the same as Qa-, the induced graph of the node pair selection matrix A. For Qq, we use 
the following assumption. 

Al. (Underlying Connectivity) The underlying graph Qq is weakly connected. 



5 



2.2 State Evolution 

Suppose node i meets another node j at time k. Independent of time, node states, and pair 
selection process, their will be three events for the iterative update for node i. 

(i) (Attraction) With probability a, node i updates as a weighted average with j, marked by 
event s^ij{k): 

Xi (k + 1) = Xi (k) + T k ( Xj (k) - Xi(k)) = (1 - T k )xi(k) + T kX j{k), (1) 
where < T k < 1 is the average weight. 

(ii) (Neglect) With probability /3, node i sticks to its current state, marked by event ^4ij(k): 

Xi (k + 1) = Xi {k). (2) 

(iii) (Repulsion) With probability 7, node i updates as a weighted average with j, but with a 
negative coefficient, marked by &ij(k): 

Xi{k + 1) = Xi(k) - S k (xj(k) - Xi{k)) = (1 + S k )xi(k) - S k Xj(k), (3) 

where S k > 0. 

Naturally we assume a + f3 + 7 = 1. Node j's update is determined by the corresponding events 
<e/ji(k), ^Yji{k) and &ji(k), which may depend on node i's update. 

2.3 Problem 

Let x° = x{k$) = {x\{ko) . . . x n (ko)) T £ R ri be the initial condition, where ko > is an arbi- 
trary integer. Denote x(k; ko,x°) = (xi(k; ko,xi(ko)) ■ ■ ■ x n (k; ko, x n (ko)^ T £ R n as the random 
process driven by the randomized update. When it is clear from the context, we will identify 
x(k;ko,x°) with x(k). 
Introduce 

H(k) = maxxj(/c), h(k) = min Xi(k) 

as the maximum and minimum states among all nodes, respectively, and define T~L(k) = H(k) — 
h(k) as the agreement measure. We make the following definition. 

Definition 2 (Agreement Convergence and Disagreement Divergence) 

(i) Agreement convergence is achieved a.s. for initial value x(ko) E R n if 

P(limsupft(&) = 0) = 1. (4) 

Global agreement convergence is achieved a.s. if holds for all initial values. 



6 



(ii) Disagreement divergence is achieved a.s. for initial value x(ko) £ if 

p( limsup?£(fc) > Al) = 1 for all M > 0. (5) 

Agreement convergence corresponds to that all states asymptotically reach the same value. 
Disagreement divergence does not only mean that agreement is not achieved, but that the 
difference of the maximum and minimum states asymptotically diverges. 

2.4 Model Rationale 

We illustrate and motivate the model introduced above through three application examples. 
False Data Injection Attacks 

Large distributed computing and control systems are vulnerable to cyber attacks. An attacker 
may inject false data or malicious code in the network, to mislead the nodes or even change 
the overall behavior of the system. The model in this paper can represent a very simple system 
under a cyber attack. The attraction event stf^ corresponds to normal operation of the system, 
under which the nodes are supposed to reach consensus. The neglect event JV^ can represent a 
denial-of-service attack, which block node i from updating its state based on information from 
its neighbor j. The injection of malicious code in node i changing its update law is modeled by 
the repulsion update. State agreement or disagreement indicates the failure or success of the 
attack. Our results in this paper allow us to explicitly characterize how large attacks a network 
can withstand. Various false data injection attacks for dynamical systems have recently been 
discussed in the literature, e.g., [39 | |50 | \ET \ [52] . 

Fault- Tolerant Systems 

'An important goal in distributed system design is to construct the system in such a way 
that it can automatically recover from partial failures without seriously affecting the overall 
performance," as pointed out in [53]. In our model the events JYij and S&ij can represent node 
faults during a randomized computation process or in the coordination of a multi-robot system. 
For example, the magnitude of the repulsion parameter Sk can indicate how severe a fault is. 
Our results show that a networked systems can sometimes be robust to quite severe faults. It is 
also shown that in certain cases the topology of the network does not play an essential role but 
the persistence and the size are more important. 

Social Networks 

Started from the classical work of DeGroot |19j . distributed averaging similar to our model has 
been widely used to characterize opinion dynamics in social networks, e.g., [201 [ZD S3 EE] . The 
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state Xi of node % is in these models the opinion of an individual. The individuals meet and 
exchange opinions. The attraction event s^ij models the trust of node % to node j. Whenever 
g/ij(k) happens, node i believes in node j and therefore takes an attraction update step. The 
parameter measures the level of trust. The neglect event JYij models the mistrust of node i to 
node j, which results in that % simply ignores j and sticks to its current opinion. The repulsion 
event St^j models the antagonism of node % to node j. In this case, node i takes the opposite 
direction to the attraction to keep a large distance to the opinion of node j. In this way, our 
model characterizes the influence of node relations to the convergence of the opinion in social 
networks. The idea follows the discussions on the possibilities of spread of misinformation and 
persistent disagreement in I48| . In addition, our model also allows for opinion divergence, as 
indicated in the definition of disagreement divergence. 

3 Impossibility Theorems 

In this section, we discuss the impossibilities of agreement convergence or disagreement diver- 
gence. 

A general impossibility theorem for agreement convergence is established as follows on the 
sequence {T^}^, i.e., on the strength of the attraction step (P). 

Theorem 1 Global agreement convergence can be achieved a.s. only if either ^fc^o^ = 00 or 
YlT=oO-~ Tk) = 00 ■ In fact, if either Y^k=Q^k < 00 orJ2kLo(^~ ^fe) < 00 holds, then for almost 
all initial values, we have 



when ho is sufficiently large. 

Proof. The proof relies on the following well-known lemma. 

Lemma 1 Let {6fc}o° be a sequence of real numbers with b k € [0, 1) for all k. Then X]^Lo = 00 
if and only if ]lfclo( 1 ~ b k) = 0. 

Now suppose Ylk^o^k < °°- Then 3Kq > s.t. Tf. < 1/2, k > Kq. Let node pair be 
selected at time k > Kq. There are two cases. 

(i) Neither xi{k) nor Xj(k) reaches the minimum value. Then straightforwardly we have 




(6) 



h(k + l) < h(k). 



(ii) One of the two nodes, say i, reaches the minimum value. In this case, we have 



Xi (k + 1) = Xi(k) + T k ( Xj (k) - Xi{k)) < h(k)+T k U{k) 



if £/ij(k) happens, and h(k + 1) < h(k) otherwise. 
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Thus, we obtain 

P(h(k + 1) < h(k) + T k n(k), k>K )= 1. (7) 
A similar analysis leads to that 

p(H(k + 1) > fT(fc) - T k H(k), k>Ko\= 1. (8) 
We see from (J7J) and © that 

P(«(* + 1) > (1 - 2T k )n(k), k>Ko) = 1. (9) 
Thus, according to Q, we conclude 

m oo 

P(n(m) > n (1 - 2T k )H(K ) > 11 (1 - 2T k )H(K ) = P *H(K )) = 1 

for all m > A"o, where = n^=_ft: (l ~~ is a constant satisfying < p* < 1 based on 
Lemma [TJ This implies 

P^limsup^(fe) > o) > P(n(m) > 0, m > K^j = 1 

for all initial conditions with ko > Kq and ~H(ko) > 0. It is obvious to see that 

{x = (x\ . . . x n ) T £ E n : xi = ■ ■ ■ = x n ) 

is a set with measure zero in IR n . The desired conclusion follows. 

Moreover, the conclusion for the other case Ylk=oO- — -^fc) ^ 00 follows from a symmetric 
argument. This completes the proof. □ 

Theorem [1] establishes two general lower bounds for the attraction update regarding a.s. 
agreement convergence. Note that Theorem[T]does not impose any assumption on the dependence 
of £&ij(k) and srfji{k) for the conclusion to stand. 

The corresponding impossibility theorem for disagreement divergence is presented as follows. 



Theorem 2 Disagreement divergence can be achieved a.s. only 2/TlfcLo(l + 2S k ) = oo. 
Proof. According to the definition of the randomized dynamics, it is straightforward to see that 

P(«(fc + 1) < (l + 2S k )H(kf) = 1 (10) 

for all k. The desired conclusion follows immediately. □ 
In the rest of the paper, we turn to the possibilities of a.s. agreement convergence and 
disagreement divergence. 
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4 Attraction vs. Neglect 



In this section, we focus on the role of node attraction for the network to reach a.s. agreement 
convergence. In the absence of node repulsion, we show how much attraction update is enough 
to guarantee global a.s. agreement under symmetric or asymmetric node dynamics, respectively. 

4.1 Symmetric Update 

Consider the case when repulsion events never take place, i.e., nodes can only follow the attrac- 
tion or neglect events. We use the following assumption, where by definition a trivial event has 
probability zero. 

A2. (Repulsion-Free) Mij(k) is a trivial event for all and k. 

This subsection focuses on the condition when the nodes' updates are symmetric when two 
nodes meet, as indicated in the following assumption. 

A3. (Symmetric Attraction) The events £/ij(k) = g/ji(k) for all and k. 
The main result for the symmetric update model is as follows. 

Proposition 1 Suppose Al, A2 and A3 hold. Global agreement convergence is achieved a.s. 
ifYlk=Q T k{^-Tk) = oo. 

Proof. With A2 and A3, the considered gossip algorithm can be expressed as 

x(k + 1) = &(k)x(k), (11) 
where Q(k) is the random matrix satisfying 

p($(k) = <S> {ij) =I-T k (e i -e j )(e i -e j ) T ^ =^(a ij + a ji ), i^j (12) 

with e m = (0 . . . 1 . . . 0) T denoting the n x 1 unit vector whose m'th component is 1. 

Define L(k) = Yl"i=l \ x i(k) ~ x ave| 2 , where x ave = YA=i x i(^o)/ n is the average of the initial 
values and | • | represents the Euclidean norm of a vector or the absolute value of a scalar. 

It is easy to verify that for every possible sample and fixed instant k, defined in (|12|) . 
is a symmetric, and doubly stochastic matrix, i.e., = 1 and 1 T ^^ = 1 T . 

Therefore, we have 

E(L{k + l)|x(fc)) = E((x(fc + 1) - x avc l) T (x(k + 1) - x avc l) \x(k)) 
= E(($(fc)x(fc) - x avc lf (^(k)x(k) - x ave l)\x(k)) 
= E((x(fc) - x ave l) T <S>(k) T $(k)(x(k) - x avc l) |sc(fc)) 
= (x(k) - x avc l) T E($ 2 (£:)) (x(k) - x avc l) (13) 
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Since every possible sample of 3>(fc) is doubly stochastic, each sample of $ 2 (£;) is also doubly 
stochastic. This implies ¥j(§(k) T &(k)) is a stochastic matrix for all k, and 1 is the eigenvector 
corresponding to eigenvalue 1 of E(<1> 2 (&;)). Thus, we can conclude from ()13p that 

E(L(* + l)|s(fc)) < A 2 (e($ 2 (£;))) (x(k) 

= A 2 (E($ 2 (fc)))L(A ; ), (14) 

where A 2 (M) for a stochastic matrix M denotes the largest eigenvalue in magnitude excluding 
the eigenvalue at one. 
Noticing that 

(i - T k (ei - ej)(ei - ej) T ^j = I - 2T k (l - T fc )(e, - ej)(ei - ej) T (15) 
we see from (|12|) that 

p(V(fc) = 1- 2T fc (l - T k ){e t - ej ){e t - ej ) T ) = ^(ay + a yi ), i / j. 
This leads to 

E($ 2 (A;)) = / - 2T k (l - T k )^-{D - (A + ^ T )), (16) 

where D = diag(di . . . d n ) with dj = Y^j=i( a ij + a i«)- 

Note that D — (A + A 7 ") is actually the (weighted) Laplacian of the graph Q a+a t. With 
assumption Al, G a+a t is a connected graph, and therefore, based on the well-known property 
of Laplacian matrix of connected graphs [2], we have A2 > 0, where A?i is the second smallest 
eigenvalue of D — (A-\-A T ). On the other hand, since A is a stochastic matrix, it is straightforward 
to see that 

a»j + a,ji < n (17) 

for alH = 1, . . . , n. According to Gershgorin's circle theorem, every eigenvalue A* of D— (A+A T ) 
is bounded by 2n. Therefore, 

< 2T k (l - T fc )^A* < 4T fc (l - T k ) < 4( Tfc + ( ^" rfc) ) 2 = 1 (18) 

for all X* £ cr(D — (A + ^4 T )), where tr(-) denotes the spectrum of a matrix. 
Now we conclude from (I16p and (I18p that for all k, 

X 2 (B(^(k))) = 1 - 2rfc(1 ~ rfc)a A$. (19) 
With (HU) and (USD, we obtain 

E(L(* + l)) < J] A 2 (E(d> 2 (,)))L(^ ) = n (l- 2Tk{l ~ Tk)a \i)L{k Q ), (20) 

i=ko i=ko 
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Therefore, based on Lemma [T] and Fatou's lemma, we have 

E( lim L(kj) < lim E(L(kj) =0, 

V k— >oo / k— >oo V / 

if J2T=oTk(l — T/.) = oo, where limfe^ 00 L(A;) exists simply from the fact that the sequence is 
non-increasing. This immediately implies 



P lim Xi(k) = x avc = 1. 

\ k— >oo / 

The proof is finished. □ 
There is an interesting connection between the impossibility statement Theorem[T]and Propo- 
sition [TJ Let us consider a special case when T k is monotone. It is not hard to find that if 
Tk+i < T k for all k, J2T=o T k( l - T k ) < co leads to Y.h=o T k < °°> wnile HkLo T kO- - T k ) < 00 
leads to Ylk^oi^ ~ Tk) < 00 if T k+ i > T k for all k. As a result, combining Theorem Q] and 
Proposition [TJ we have the following conclusion. 

Theorem 3 Suppose Al, A2 and A3 hold. Assume that either T k+ i < T k or T k+ \ > T k 
for all k. Then X^O^M^ ~~ Tk) = co is a threshold condition regarding global a.s. agreement 
convergence: 

(i) P(limsup fe _ Kx) 'H(A;) = 0) = for almost all initial conditions with k$ sufficiently large if 
ET=o T k(l-T k )<oo; 

(ii) P( lim sup/^oo %{k) = 0) = 1 for all initial conditions if YH£=oTk(l — T k ) = 00. 

4.2 Asymmetric Update 

In this subsection, we investigate the case when the node updates are asymmetric, as indicated 
by the following assumption. 

A4. (Asymmetric Attraction) &?ij(k) (~) <s/ji(k) is a trivial event for all (i,j) and k. 
We present the main result for the asymmetric update model as follows. 

Proposition 2 Suppose Al, A2 and A4 hold. Then global agreement convergence is achieved 
a.s. if 



00 



k=0 



(fc+l)(n-l)-l 



II r.(i-r 5 ) 

s=k(n— 1) 



OO. 



Proof. Take fc* > 0. Denote a* = minjajj : a^- > 0} as the lower bound of the nonzero entries 
of A. Suppose io is some node satisfying Xi (k*) = h(k*). 

Let i\ be a node which is connected to io in graph Qq. We see that such i\ exists based on 
the weak connectivity assumption Al. With assumptions A2 and A4, we have 

P^pair (io,h) or «o) selected, and s^% x i a happens^ > —at. 
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Moreover, if ^ 1 i happens, we have 

X j 1 (k* + 1) = Xij (fc*) + Tfc, (x (fc.)) 
= T k ^x io (K) + (1 - Tfejxi^fe*) 

<rfc,h(fc*) + (i-T*,)fl-(fcO 

< T fc ,(l - T fc J/i(fcO + (1 - T fc .(l - T K ))H{K) 
and Xi (k* + 1) = Xj (fc*) according to assumption A4. This implies 

P^fc* + 1) < T fc ,(l - T K )h{K) + (1 - Tfc,(l - T K ))H{K) and x io (fc* + 1) = x^fc*)) > ^a. 

Next, according to the weak connectivity assumption Al, another node i 2 can be found such 
that i% is connected to {io,ii} i n Go- There will be two cases. 

(i) i2 is connected to io in Qq. Then by a similar analysis we used for bounding Xj^fc* + 1), 
we obtain 

P^ioC^* + 2) = Xj (fc*), Xi 1 (k :¥ + 2) = Xi 1 (k :¥ + 1), 

and Xj 2 (£;* + 2) < Tj^+i/^fc*) + (1 - T K+1 )H(k*) ) > —a. 

(ii) i 2 is connected to ^ in C/q. Suppose pair (ii,^) or (*2j*i) selected, and happens at 
time fc* + 1. Then we have 

(fc* + 2) = x^fc* + 1) 

and 

(fc* + 2) = x i2 (fc* + 1) +T fc 

< (1 - T K+l )H(K + 1) + rfc.+i(T fc .(l - IfcJ/tO*) + (1 - 2^(1 - T fc .)) 

< (1 - T K+1 )H{K) + T fc .+i(r fc .(l - T K )h{K) + (1 - Tfc.(l - T kt ))H(K)) 

= T K+1 T K (l - T K )h{h) + (l - T K+1 T K (l - T k S)H{K) 
fc*+i 

< n r t( i - t ^ + H (k*)(i - n - T k)) 

k — k^ k — k* 

conditioned that pair (io,h) or («i,io) selected, and happens at time fc*. 
Noting the fact that 

fc*+i 

T k Mk*) + (±-T K )H(k*)<h{h) Yl T k (l-T k ) + H(h)(l- JjTfcCl-Tfc)), 
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we conclude from either of the two cases that 

P(x r (h + 2)<h(h) J] T k (l-T k )+H(k*)(l- J] r fc (l-T fc )), r = i ,ii,i 2 ) > 

Ay J\ilJf. Al Aj^; 

Continuing we obtain that for nodes 13, ... , i n -i, 

kt+n-2 k,+n-2 

p(x T (h + n-l)<h(K) J] T k {l-T k ) + H{K)(l- J] r fc (i-r fc )), 

Ai — Aj^ A? — A^ 

r = i , . . .,i n -i j > [—) 

which yields 

fc*+n-2 k,+n-2 , 

v[H{K + n-l)<h{K) [J T k (l-T k ) + H(h)(l- J] T k0- ~ T k))) > {^ff ■ 

Aj Aj^t Ay Ay:fc 

(21) 

With ([21]), we obtain 

fc,+n-2 



P(n(k* + n-l)<(l- T k (l-T k ))n(K))>( — ) ■ (22) 



T k (i-T k ))n(K)) > 

k=k, ' 

Since assumption A2 guarantees %{k + 1) < %(£;) for all k with probability one, (|22h leads to 

_ x k,+n-2 

E(H(^+n-l))<(l-(^) n [] r fe (l-r fe ))E(^(^)). (23) 
Note that fc* is chosen arbitrarily in the upper analysis. We conclude by induction that 

_ 1 fc»+(s+l)(n-l)-l 

E^fc* + (s + l)(n - 1))) < (l - [J ^ " T k ))v(n{h + s(n - 1))) 

k=k t ,+s(n— 1) 

for all s = 0, 1, . . . . Particularly, we choose = -K"o( n — 1) > ^0 for some integer A'o > 0, where 
ho is the initial time, we obtain 

(t+l)(„-l)-l 



V n 

t=-f!To fc=t(n-l) 



E(w(( fl + l)(n-l)))< [J l 1 -!^ 1 ) r fc (l-r fc ))B(«(lfo(n-l) 
which implies 



E( HmW(a(n- 1))) < jkE[«(<(n- 1)) ) = (24) 

f-l) 
fc(» 



by Fatou's Lemma and Lemma [T] as long as X^fcLo Ilitifcr —i^ ~~ ^s) = °°- Therefore 



observing that T~L{k) is non-increasing, (|24p leads to 



P( limsup^(fe) = 0) = 1. (25) 

k— >oo ' 
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The desired conclusion follows. □ 
We see from Propositions Q] and [2] that it is easier to achieve agreement convergence with 

symmetric updates, which is consistent with the literature |43| . 

Again let us consider the case when is monotone. The following lemma holds. 

Lemma 2 Let be a sequence of real numbers with b^ 6 [0, 1] for all k. 

(i) Suppose < 6fc f° r M k. Then the following statements are equivalent. 

a)EltoUt + ^ ) iyi b s (l-b s ) = oo; 
V £~0 (^(l-6 s )) n_1 = oo; 

(ii) Suppose bk+i > bk for all k. Then the following statements are equivalent. 

r(fc+l)(n-l 
U=fe(n-1) 



a;E£oIl2JJte 1) " 1 Ml-6.) = oo; 



n— 1 

E^ol^C 1 - 6 *)) = 00 >' 



Proof. We just prove (i). Case (ii) holds by a similar analysis. Note that, we have 

(fc+l)(n-l)-l (fc+l)(n-l)-l 

(1 - ^Cdm < II b a (l-b.)< n ^<ti). (26) 

s=k(n— 1) s=fc(n— 1) 

where without loss of generality we assume &o > 0. Moreover, the monotonicity of {b^} guarantees 

oo oo oo 

(«-i)£ ^+i)(n-i) < E fc r x * (» - !) E ( 27 ) 

k=0 k=0 k=0 

We see from ([26]) and (I27p that statements a) and c) are equivalent. 
On the other hand, observing that 

oo oo ^ oo 

(i - ftor^E 6 " -1 ^ E ( 6 -d - M) n ~ ^ E 6 "" 1 ' 

s=0 s=0 s=0 

also statements b) and c) are equivalent. The desired conclusion follows. □ 
Combining Proposition [2] and Lemma [21 we obtain the following conclusion. 

Theorem 4 Suppose Al, A2 and A3 ZioW. Assume that either < or T^ + i > /or 
all k. Then global agreement convergence is achieved a.s. if 

OO -, 

E(( 1 - r *) r *) = °°- 

fc=0 

We see from Theorems and 0] that the requirement for the sequence to guarantee 

a.s. agreement convergence increases from EfcLo-^fcO- ~~ -^fc) = 00 t° Efclo ((1 ~~ ^fc)?!-)™ 1 = oo 
when the update transits from symmetric to asymmetric. Hence, these results quantify the cost 
of asymptotic updates versus the strength of attraction. 
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5 Attraction vs. Repulsion 



In this section, we discuss the case when node repulsion is present in the model. Intuitively the 
main challenge here is whether the network reaches agreement convergence, or disagreement 
divergence, depending on which one can beat another one among node attraction and node 
repulsion In the following, we study symmetric and asymmetric updates, respectively. 

5.1 Symmetric Update 

We first consider the case when the node updates are symmetric, as described in the following 
assumption. 

A5. (Symmetric Update) The events £?ij{k) = &?ji(k) and &ij(k) = &u{k) for all (i,j) and k. 

Let A2 and A* be the second smallest and largest eigenvalues of D — (A + A T ) with D = 
diag(di . . . d n ), d% = X^/=i( a *i + a j«)i respectively. The main result on a.s. agreement convergence 
under symmetric update is stated as follows. 

Proposition 3 Suppose Al and A5 hold. Global agreement convergence is achieved a.s. if 

00 _ 

IK 1 -;*)-* 

fc=0 

where 

(T k (l-T k )a-S k (l + S k h)\* 2 , ifT k (l-T k )>S k (l + S k ); 
X k = \ ) ' (28) 

T k (l - T k )a - S k (l + Sfeh) A*, ifT k (l - T k ) < S k (l + S k ). 



Proof. With assumption A5, the considered algorithm can be expressed as 

x(k + 1) = V(k)x(k), (29) 
where ^(k) is a random matrix satisfying 

P (*(*:) = =1 — T k (ei - ej)(ei - ej ) T ) = -(ay + ap), i / j 
corresponding to event £/ij(k), and 

p(*(fc) = ^ = I + S k {ei - ej)(ei - ejf^j = ^( aij + aji ), i ^ j. 

corresponding to event &ij(k). 

Recall that L(k) = Yli=i \ x i(^) ~ x ave\ 2 i where x ave = Y17=i x iO t o)/ n 1S the initial average. 
It is crucial to notice that every possible sample of of the random matrix ^f(k) is symmetric and 
(generalized) stochastic since its row sum equals one, even though there are negative entries for 
the matrices ^"Zjy Therefore, similar to (|13|) . we have 

E(L(k + l)\x(kj) = (x(k) - x avc l) T E(^ 2 (fc)) (x(k) - x ave l). (30) 
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Noticing (fT5|) and 

(i + S k (ei - ej)(ei - ej) T ^j = I + 2S k (l + 5 , fc )(e i - e.,)(e, - ej) T 

we obtain 

E(* 2 (£:)) = I — 2(r fc (l - T fc )a - S fc (l + S fc fr) ^ (l? - (A + ^4 T )) • (31) 
There are two cases. 

(i) . Suppose T k (l — Tfc) > S k (l + S k )- Recalling that every eigenvalue A* of D — (A + A T ) is 

bounded by 2n, we have 

< 2(r fc (l - T fc )a - S k (l + 5*) 7 ) ^A* < 2(^(1 - T fc )a) ^A* < 4T fc (l - T fc ) < 1 

for all A* G a(L> - (A + A T )). Thus, all the eigenvalues of E(* 2 (fc)) are contained within 
the unit circle. This implies 

E(L(k + l)|x(fc)) < (x(k) - x avc l) T E(^\k)) (x(k) - x avc l) 

< (l - 2{T k (l - T k )a -S k (l + S k )j) h* 2 ) L{k) 
= (l- 2 ~T k )L(k). 

(ii) . Suppose T k (l — T k ) < S k (l + Sk). Then we have 

1 < A,(e(* 2 (£;))) < 1 - 2(r fc (l - T k )a - S k (l + 5 fe ) 7 ) 
for all eigenvalues of E(^ 2 (A;)) , which also yields 

e(l(£: + l)\x{k)) < (l - ^X fc )L(fc). 

Therefore, repeating the analysis in the proof of Proposition [TJ we obtain 

E(limsupL(fc)) < limsupE(L(fc)) =0, 

as long as II^Lo ~~ = ® m This immediately implies 

P( lim Xi(k) = x ave ) = 1, 
V fc->oo / 

which completes the proof. □ 

Next, we discuss the state disagreement under symmetric updates. The following conclusion 
holds on the state disagreement in expectation. 



17 



Proposition 4 Suppose Al and A5 hold. Disagreement convergence is achieved in expectation, 
i.e., Hindoo E(H(/c)) = oo, for almost all initial values if 



oo „ 
fc=0 



oo, 



where 



T k (l-T k )a-S k (l + S k h)X* n , ifT k (l-T k )>S k (l + S k ); 
Zk={) I (32) 

T fc (l - T fc )a - 5 fc (l + S k h)\* 2 , ifT k {\ - T k ) < S k (l + S k ). 



Proof. By establishing the upper bound of the right-hand side of Eq. (|30|) . we obtain 

e(l(A; + l)|x(fc)) > (l - ^±k)L(k) 

for all k, which implies 

E(L(k + l))>(l--i k )B(L(k)). (33) 



n 

This implies the desired conclusion straightforwardly. □ 
For a.s. disagreement divergence, we present the following result. 

Proposition 5 Suppose Al and A5 hold. Disagreement divergence is achieved a.s. for almost 
all initial conditions if 

(i) there exists a constant S* > such that S k < S* for all k; 

(ii) there exists a constant < e < 1/2 such that either T k £ [0, 1/2 — e] or T k G [1/2 + e, 1] 
for all k; 

(Hi) there exists < r < 1 such that limsup m _ ) . OC) Xwb=o Jr{k) = 0(m), where 
J T (k) = log [(1 + 4T(S 2 k + S k )) Pk (2T k - l) 2a 

withp k = — ^-^Tr^- tfgif Q + f fc ^ ) and by definitionb k = 0(c k ) means thatlimsup k ^ 00 b(k) /c(k) < 
oo is a nonzero constant. 

Proof. We divide the proof into three steps. 

Step 1. In this step, we show that with probability one and for almost all initial conditions, 
finite-time agreement convergence cannot be achieved. According to ©, we obtain 

P(n(k + 1) > (l-2T fc )«(fc)) =1 

for all k > if T k £ [0, 1/2 - e]. Observing that 1 - 2T k > 2e > we see that H(k) > for all 
k with probability one for all initial values satisfying rl(ko) > 0. This holds also for the other 
case T k £ [1/2 + e, 1] based on a symmetric argument. 
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Suppose nodes u and v reach the maximum and minimum values at time k, respectively, i.e., 

x u {k) = maxii(fe); x v (k) = mmxi(k). 

Then we have 

n l 1 

= ^ ^ \xi(Ji) — x avc | > — x ave | + |x,;(A;) — x avc | > — \x u (k) — x v (k)\ = —H (fe), 

i=i 

which implies L{k) > with probability one for almost all initial conditions. 

Therefore, with probability one, we can introduce a sequence of random variables {w k } 
satisfying 

L(k + 1) = w k L(k), k > 0, 

and we see from (1331) that 



OG 





E(tz7 fc ) = E(L(A + l))/E(L(fc)) > 1 - -X fc = Z*. (34) 

Step 2. We establish a lower bound for E(logtzjfc) in this step. 

Recall that ^(k) is the random matrix introduced in (|29p . It is not hard to find that for 
every possible sample, or ^fe) °f ^K&)i ^ holds that 



mm 



|Ai| : Aj G C j(^+. ) )U C j(^-. ) )} > minjlAil : A, G = 2T fc - 1, (35) 

where 

Vt = I 

T k 1-T k 



/ 1 - T k T k \ 
V k=\ m * * ■ (36) 



Noticing that 

L(ft + 1) = (s(fc) - x ave l) T ^ 2 (&)(x(A0 - x avc l) > min \Xi\ 2 L(k), 

the definition of -cc^ and (|35|) yield 

p(ro fc > (2T k - l) 2 ) = p(logro fc > log(2T fc - l) 2 ) = 1. (37) 
Similarly, observing that 

max{|Ai|: A^ G a(^+. ) ) U a^^)} < max ||Ai| : \ { £ a(V k )} = 2S k + 1, (38) 

where 

Vk = 



1 + S k —S k 
—S k 1 + s k 



we obtain 

P(ro fc < {2S k + l) 2 ) = p(logro fc < log(25 fc + l) 2 ) = 1. (39) 
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Noticing ([Ml) and that 



E(n7 fc ) = / KJk+ rofc < 1 + / ttffc, 



we obtain 



/ ro fe > E(tJ7 fc ) - 1 > Z k - 1. 

Jro fe >l 

Take < r < 1 a constant. Based on the definition of the desired algorithm, we see that 
P( w k > l) < P(&ij(k) happens for some node pair J = 7. 



Now we conclude that 

Z k -l< j w k <p k {2S k + l) 2 + {l-T + T(2S k + l) 2 )( 1 -p k ) 1 (40) 

Jw u >l 

where by definition 

p k = P(l - r + r(2S k + l) 2 < w k < {2S k + l) 2 ). 
After some simple algebra we see from (|40p that 

. > Z fc -1- 7 (1-T + T(2ff fc + 1) 2 ) |i fc + 7 (l + 4r(g 2 + 5 fc )) ^ 

4(l-r)(5 2 + 5 fc ) 4(l-r)(5 2 + 5 fc ) Pk ' ^ 



Combining (|37p , (J39J) and (|4ip , we eventually arrive at the following lower bound of E log w k : 
E log w k > p k log (l - r + r(2S k + l) 2 ) + a log(2T fc - l) 2 

,2«" 



> log 



[l + ir(S 2 k + S k )) Pk (2T k -iy 



= J T (k). (42) 

Step 3. In this step, we complete the final piece of the proof by a contradiction argument. 
Suppose there exist two constants Mq > and < p < 1 such that 

P ( lim sup H(k) < M ) = p. (43) 



Noticing that 



L{k) = M*0 - ^avd 2 < nU 2 (k), 



i=l 



we further conclude 



p(limsupL(fc) < uMq J > p, 
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which yields 

m 

P ( lim sup log L(m + 1) = ~S~] l°g w k < log (uMq ) J > p. 

This leads to 

pf lim ^=° lOgWk <0)>p. (44) 

On the other hand, noting that the node updates are independent of time and node states, 
and that V(logtUfc) is bounded according to (|37|) and (|39|) . the Strong Law of Large Numbers 
and (|45j) suggest that 

Pf lim - V (logti7 fc - J r (fc)) > 0) > Pf lim - V (logro fc - Elogn7 fc ) = o) = 1, 

\ m— yoq 777, L — * /V m— >-oo 777 ^— » / 

fc=0 fe=0 

which contradicts ([31]) if limsup,^^^ XlfcLo ^r(k) = 0(m). 

The desired conclusion thus follows and this completes the proof. □ 

We conclude this subsection by the following conclusion under the condition when T\. and 
Sfc are time-invariant, which follows straightforwardly from Propositions [3l U] and [5j 

Theorem 5 Suppose Al and A5 hold. Let € [0, 1] and > be two given constants. 
Assume that = and Sk = S+. Then 

D = S*(l + S,h - T*(l - T*)a 

is a critical convergence measure regarding the state convergence of the considered network. To 
be precise, we have 

(i) Global agreement convergence is achieved a.s. if Dq < 0; 

(ii) Disagreement divergence is achieved in expectation for almost all initial values if Dq > 0; 

(Hi) State oscillation is achieved in expectation, i.e., E(L(fc)) = L{ko) for all k>k$ if Dq = 0; 

(iv) Disagreement divergence is achieved a.s. for almost all initial conditions ifT* ^ 1/2 and 
Dq is sufficiently large, i.e., there exists < r < 1 such that 

{l + 4T(Sl + S*)f{2T*-l) 2a >l, 

where 

, = 27g A^-n 7 (l + 4r(5, 2 + ^)) 
P 4n(l-r)(S* + S*) 

Remark 1 It is surprising that the convergence measure Dq in Theorem [5| does not rely on the 
network topology. This is to say, if all the nodes may misbehave with equal probability as the 
proposed algorithm, then there is no particular topology which can be viewed as "better" than 
others in terms of agreement convergence. 
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5.2 Asymmetric Update 

In this subsection, we discuss asymmetric node updates. We introduce the following assumption. 

A6. (Asymmetric Update) Both g/ij(k) [}&fji(k) and Mij{k) (~)&ji(k) are trivial events for all 
and k. 

The main result on a.s. agreement convergence under asymmetric update is as follows. 

Proposition 6 Suppose Al and A6 hold. Global agreement convergence is achieved a.s. if there 
exists S* > a such that S k < S* for all k and 



n 

fc=0 



M^T r fe+ (i-(i- 7 rM(4-i 



n 



n-1 



n-1 



0. 



(45) 



where 



(fc+l)(n-l)-l (fe+l)(n-l)-l 

f k = J] T m (l-T m ); S k = Yl (S m + l). 

m=k(n— 1) m=k(n— 1) 

Proof. Following from the proof of Proposition [2 we have 

fc*+n-2 



P(«(fc*+n-l)< (l- J] T k {\-T k ))H(K)) > 



n-1 



(46) 



for all fc* > 0. 

On the other hand, the definition of the randomized algorithm leads to 

(fc*+n-2 \ 
H(h+n-l)<( 11 (S k + l))H{h) =1 
k=k, J 

and 



P(n(K + n-l) >n(k*)) <l-(l-7) 



,n-l 



(47) 



(48) 



since H(k if +n— 1) > implies that repulsion happens at least one time during [k*, fc*+n— 1). 

We conclude from (gSJ) and flU} that 



E(W(fc» + n-l)) < 



n-1 



fc„+n-2 



n-1 



ao, 



n-1 



+ (l-(l-7) 

fc*+n-2 

n T k (i-T k ) 

k=k* 



n-1 



K+n-2 



n (s k +i) 

k=k, 



E(tt(fe0) 



fc»+n-2 



+(i-(i-7)- i )( n 
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for all fc* > 0. This implies 

e( lim n(s(n -I))) < lim E(u(s(n -I))) =0 (49) 

if (|45l) holds, and thus 

Pf lim H(k(n- 1)) = o) = 1. (50) 

V fc— s-oo / 

Since there exists S* > a such that < <S* for all k, we see from (|47p and (|50p that 

The desired conclusion follows. □ 

Next, we study a.s. disagreement divergence. The following conclusion holds. 

Proposition 7 Suppose Al and A6 hold. Disagreement divergence is achieved a.s. for almost 
all initial values if 

(i) there exist two constants S* > and < T* < 1 such that S). < S* and T k < T* for all 

k. 

(ii) there exists an integer Z > such that Y^k=o<Jz{k) = 0(m), where 

-i (fc+i)(2+i)-i (fc+i)(z+i)-i 

^«=(^) io g (^ n (i+^))+(i-(i-«r i )io g n a-^)- 

S=fc(Z+l) s=fc(Z+l) 

Proof. Suppose node pair (i,j) is selected at time k. According to the definition of the considered 
randomized algorithm, we obtain 



\xi(k + 1) — Xj(k + 1)1 = < 



\xi(k) — Xj(k)\, if tAij(k) happens; 

(1 - T k )\xi(k) - Xj(k)\, if Mj(k) happens; (51) 

(1 + Sk)\xi(k) — Xj(k)\, if &ij(k) happens. 



Therefore, with assumption A6, we obtain 

p(H(k + 1)>(1- T k )n{k)) > P(n{k + 1)>(1- T*)H(kj) = 1 



for all k > 0. This implies for all initial values satisfying %(ko) > 0, agreement convergence is 
achieved only in infinite time with probability one. As a result, we can well define a sequence of 
random variable, {ro^lg , such that 

H(k + 1) = w k H(k), k > 0. 

Now with (|5ip . it is straightforward to conclude that 

P(w fc >l-T fc )=l (52) 
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and 

Y>[w k < l\ < a. (53) 

Moreover, based on the weak connectivity assumption Al, for any k > 0, there always exist two 
nodes Iq and jo such that either aj 0j0 > or aj i > 0, and 

\xio(k) - x jo (k)\ > ——^H{k). 

Note that if a,i j > or a J0 j > 0, and a?j (fc) — Xj (k)\ > f/H(k) for some \x > 0, we have 
KCj (A; + 1) — Xj (k + 1) > (1 + Sk)fiH(k) with probability ja*/n. 
Thus, the case with Mij(k) happening in (|5"Tj) leads to 

P(^>i±^)>^, (54) 
V n — 1 / n 



and 



fc+s 



P(*lk + .---**>-^ i n(l + 5 ? )) > «>0 (55) 

<r=fc 

recalling that a* = minjajj : ay > 0} is the lower bound of the nonzero entries of A. 

Therefore, letting Z > be an integer, we can eventually conclude from (|52p . (|53p and (|55p 
that 

"ff Eiog^ > (^) Z+1 io g *ff (! + + (i - (i - logoff (i " r*)- 

Aj Al;fc Al Aj^; Aj Ay^: 

The desired conclusion follows from the same argument as the proof of Proposition [5] based on 
the Strong Law of Large Numbers. This completes the proof. □ 

We also end the discussion of this subsection by a theorem for the case when and Sk are 
time-invariant. Applying the same analysis methods of proving Propositions [6] and we obtain 
the following result. 

Theorem 6 Suppose Al and A6 hold. Let T+ € [0, 1] and S* > be two given constants. 
Assume that Tf. = T* and Sk = 5*. Then we have 

(i) Global agreement convergence is achieved a.s. if 

(l - (1 - ,)-')((* + 1)-' - l) < max { T„ 1 - T,})"-\ 

(ii) Disagreement divergence is achieved a.s. for almost all initial conditions if there exists an 
integer Z > such that 



Remark 2 is unclear from Theorems^ and\^ if symmetric or asymmetric updates are better 
guiding the network states to agreement or disagreement. In order to answer this question, more 
accurate estimates of the state evolution are needed. We guess the answer will highly depend on 
the network topology. 
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Figure 1: The underlying communication graph. 



5.3 Numerical Example 



We present a numerical example in order to illustrate the critical measure established in Theorem 

El 

Consider four nodes 1, . . . , 4. The node meeting probability matrix is given by 



.4 



/ 1/2 l/2\ 

1/2 1/4 1/4 

1/3 2/3 

V 1/3 2/3 J 



The underlying graph Qq is shown in the Fig. Q3 The initial values are taken as Xj(0) = i,i = 
1, . . . , 4. We take a = (3 = 7 = 1/3 and let Tk = T+ and Sk = S*. 

Take T* = 1/4 and = (y/7 - 2)/4, {yjl - 2)/4 - 0.05, (y/7 - 2)/4 + 0.05, respectively. 
The corresponding values of Dq = S*(l + 5*)7 — T*(l — T + )a are then given by 0, —0.0212, and 
0.0229. We run the considered randomized algorithm for 10 5 times, and then take the average 



value of the consensus measure L(k) = Ylt=i { x i{k) 



as the empirical estimate of the 



expected value of L(k). The transition of E(L(fc)) for these three cases of Dq is shown in Fig. [2l 
The numerical result is consistent with the conclusion in Theorem El 



6 Conclusions 

This paper proposed a model for investigating node misbehavior in distributed information pro- 
cessing over random networks. At each instance, two nodes were selected for a meeting with 
a given probability. When nodes meet, there were three events for the node update: attrac- 
tion, neglect, or repulsion. Attraction event follows the standard averaging algorithm targeting 
a consensus; neglect event means the selected node will stick to its current state; repulsion event 
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2 1 1 1 1 1 1 

5 10 15 20 25 30 

k 

Figure 2: The expected value of L(k) for different .Do- 
represents the case when nodes are against the consensus convergence. Each node was assumed to 
follow one of these three update rules at random. Both symmetric and asymmetric node updates 
were studied. After obtaining two general impossibility theorems, a series of necessary and/or 
sufficient conditions were established for the network to reach a.s. agreement convergence, or 
a.s. disagreement divergence. For the symmetric update model, we established a critical conver- 
gence measure stating that convergence transits from agreement to disagreement whenever this 
measure goes from negative to positive. The proposed algorithm may serve a uniform model for 
characterizing node misbehavior in communication network, large-scale control system, or social 
networks. To the best of our knowledge, the obtained results for the first time in the literature 
gave a clear description on the possible disagreement divergence for distributed averaging due 
to node misbehavior. More challenges lie in the optimal policy for the nodes to take bad action 
from a tradeoff between the risk of being discovered and the result it generates, and the case 
when bad action only takes place for some particular neighboring relations. 
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